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STATEMENT OF FOCUS 



The Wisconsin Research and Development Center for Cognitive Learning 
focuses on contributing to a better understanding of cognitive learning by 
children and youth and to the improvement of related educational practices. 
The strategy for research and development is comprehensive. It includes 
basic research to generate new knowledge about the conditions and processes 
of learning and about the processes of instruction, and the subsequent de- 
velopment of research-based instructional materials, many of which are 
designed for use by teachers and others for use by students. These materials 
are tested and refined in school settings. Throughout these operations be- 
havioral scientists, curriculum experts, academic scholars, and school 
people interact, insuring that the results of Center activities are based 
soundly on knowledge of subject matter and cognitive learning and that 
they are applied to the improvement of educational practice. 

This Technical Report is from the Basic Pleading Skills: Identification 
and Improvement element of the Reading and Related Language Arts Project, 
in Program 2, Processes and Programs of Instruction. The objectives of 
Program 2 are to develop curriculum materials for elementary and preschool 
children, to develop related instructional procedures, and to test and re- 
fine the instructional programs incorporating the curriculum materials and 
instructional procedures. Contributing to these objectives, this project 
has two general objectives: (1) to develop kindergarten level tests for 
diagnosing deficits in skills which relate to reading, and (2) to develop a 
kindergarten-level program for teaching these skills. Tests and instruc- 
tional programs will be developed for: visual and acoustic skills, includ- 
ing letter and letter-string matching with attention to order, orientation, 
and detail; auditory matching, segmentation, and blending; and for relating 
sounds to symbols. 
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ABSTRACT 



This report summarizes the findings of a Fall 1970 administration of 
the Wisconsin Basic Prereading Skill Test to 162 entering kindergartners. 
The test is being developed to diagnose prereading skill deficits in 
kindergartners and to predict end-of-first grade reading achievement. 
Included in the Fall administration were subtests for attending to letter 
order, letter orientation, and letter-string detail, and for segmenting 
sound sequences. A test for letter-naming ability was included for com- 
parison to previous versions of the test, but will not be retained in the 
final version. Results are presented and the implications for test revi- 
sion discussed. 
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INTRODUCTION 



The Wisconsin Basic Prereading Skill Test 
(BPST) is intended to diagnose specific pre- 
reading skill deficits and to predict first grade 
reading success in kindergartners, In its cur- 
rent version, the BPST is individually admin- 
istered in a single session of approximately 
15 minutes, 1 Three visual skills are sepa- 
rately tested: attention to letter orientation, 
letter order, and letter detail. The only audi- 
tory skill included in the current battery is 
the ability to learn to segment words (e, g, , 
respond "eyes" to "pies' 1 ) and to transfer that 



*The test items and the examiner's script 
for the 1970 Basic Prereading Skill Test are 
presented in the Appendices, 



learning to new words, 2 A test of ability to 
name letters, included for experimental pur- 
poses, will be deleted from the final BPST ver- 
sion. 

The research leading to the choice of these 
specific prereading skills for assessment and 
instruction is described in Calfee, Chapman, 
and Venezky (1970) and Venezky and Chapman 
(in press). In this report, the results of ad- 
ministering the BPST to 162 entering kinder- 
gartners are presented and the implications for 
further test development and revision are dis- 
cussed. 



2 Additional auditory tests are being devel- 
oped for sound matching and blending. 
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II 

METHOD 



THE BPST VISUAL TESTS 

Each of the three visual skill tests was a 
matching task requiring about 2 minutes for 
administration. A test item consisted of a 
standard and 4 alternates displayed horizon- 
tally with the standard at the left. The child 
was asked to point to the alternate just like 
the standard. The three tests differed pri- 
marily in the types of incorrect alternates 
constructed and the number of letters in the 
standards. In each test, the correct alternate 
and each type of incorrect alternate occurred 
equally often in each of the 4 positions. 



Letter Order 

The standards for the 16 items of this test 
were all letter pairs, half upper case and half 
lower case. (The 2 letters forming the standard 
were similar to each other half the time and 
dissimilar the other half. ) The three distrac- 
tors for a standard always included a pair in 
which the letters of the standard occurred in 
reverse order, a pair in which a similar letter 
was substituted for the first letter, and a pair 
in which a similar letter was substituted for 
the second letter. This test was the only one 
of the three permitting a child to make an 
order reversal error. 



Letter Orientation 

The standards for the 12 items of this test 
were the single letters £, £, b, dj pairs of 
letters including each of the set {r, £, b, d} 
initially; and pairs including each of this set 
finally. Distractors were formed for each item 
by substituting each of the remaining letters of 
the set a, b, d} for the one used in the 
standard (e. g. , jpa .qa_ pa_ ba_ da). Thus 
each distractor was an orientation transforma- 
tion of the standard: left-right, up-down, or 
180° rotation. This test was intended to be 



the only one of the three permitting orienta- 
tion errors. 



Letter Position Detail 

The standards for the 12 items of this test 
were ^letter triples (6) and letter quadruples 
(6), half upper case and half lower case. The 
three distractors for each letter triple were 
formed by substituting a single letter for each 
letter of the triple. For quadruples, the pro- 
cedure was identical except that no substitu- 
tion was made for the initial letter. This 
test permitted only single letter mismatches. 



THE BPST AUDITORY TESTS 
Segmentation 

This was an anticipatory paired-associate 
learning task of five trials, preceded by a 
study trial. The experimenter (E) said the 
stimulus word (e. g. , "pies") and supplied the 
correct response (e. g. , 'byes") if the child 
failed to say it. The list consisted of three 
pairs of words in which the stimulus was of 
consonant-vowel-consonant structure. The 
response, in each case, consisted of the 
vowel-consonant segment, which was also a 
real word. After five trials, the child was 
asked to guess the response to six new words 
(the Transfer task). The correct responses 
were real words. The entire learning and 
transfer task took approximately 5 minutes. 



OTHER COMPONENTS 
Alphabet Naming 

The ten upper-case letters most likely to 
be known to the children were presented in 
random order. Children were asked to name 
each letter. The task required approximately 
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2 minutes. This test was not intended to be 
a portion of the final BPST but rather to provide 
a rough prediction of reading readiness to which 
the BPST tests could be related. 



Rest-break 

A short game of "Simon Says" in which the 
child was asked to stand up, stretch, and 
move around was provided as a break about 
half-way through the test battery. 



TEST ADMINISTRATION 

Actual testing order was as follows: Letter 
Orientation, Alphabet Naming, Letter Position 
Detail, Rest-Break, Letter Order, Segmenta- 
tion, and Transfer. Two versions (A and B) 
of the entire set of tests were constructed. 
They differed only in the randomization of 
items on each of the visual tests and Alphabet 
Naming and in the list of pairs to be learned 
or guessed in Segmentation and Transfer. 
Subjects (Ss) were randomly assigned to one 
of the two versions. The test items for ver- 
sions A and B are given in Appendix A. The 
script and score sheets for test administration 
are contained in Appendix B. 



Table 1 



.Ss Participating in Fall 1970 Basic Prereading Skill Test 



Group 




Number Ss 






Mean Age in Months 


Male 


Female 


All Ss 


Male 


Female 


All Ss 


Hawthorne Class 1 


7 


13 


20 


66. 0 


65. 7 


65. 8 


Hawthorne Class 2 


9 


14 


23 


64. 7 


63.2 


63. 8 


Hawthorne Class 3 


9 


14 


23 


68. 0 


64. 5 


65.9 


Low SES 


25 


41 


66 


66. 2 


64.4 


65. 1 


Glendale Class 1 


9 


18 


27 


65.8 


64.4 


64.9 


Glendale Class 2 


13 


9 


22 


65. 7 


66. 2 


65. 9 


Mid SES 


22 


27 


49 


65. 7 


65. 0 


65. 3 


Stephens 


11 


17 


28 


65. 7 


63. 5 


64.4 


Muir 


.3 


10 


19 


67 f 3 


66. 8 


67. 1 


Hi SES 


20 


27 


47 


66. 5 


64.7 


65. 5 


All Ss 


67 


95 


162 


66. 1 


64.7 


65. 3 



Two female and one male graduate students 
served as test administrators. Children were 
tested individually in a quiet room; the test 
required about 15 minutes. Responses given 
to each test iterm were coded by the E. Chil- 
dren at two of the schools (Hawthorne and 
Glendale) were tested the first week of Octo- 
ber 1970; those at the other two (Stephens and 
Muir), the first week of November 197 0. 



SUBJECTS 

One hundred sixty-two kindergartners from 
four Madison elementary schools participated 
in the 1970 study. The schools differed in the 
socioeconomic status (SES) of the families 
from which the kindergartners were drawn. 
Hawthorne, with 30% of its children eligible 
for Title 1 aid, represented the lower end of 
the SES spectrum; Glendale, with approximately 
12% of its children eligible for Title 1 aid, a 
mid-point; and Muir and Stephens, suburban 
elementary schools with no Title 1 children, 
the higher end of the SES spectrum. A break- 
down of Ss by SES group, school, class, and 
sex is given in Table 1, together with the 
mean age of each group. 
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Number of items on test* 



Ill 

RESULTS 



Summary statistics of performance for all 
Ss and the three SES groups are given in Table 
2; the percent correct per S, the mean number 
of items correct, and the standard deviation 
of the number correct scores. Comparable 
figures from a 1969 October administration of 
an earlier BPST version to Hawthorne kinder- 
gartners are also included in Table 2. 

According to the data in Table 2, the higher 
SES groups are uniformly better than the lower 
SES groups on each test. In Table 3 are shown 
the results of J^-tests comparing high and mid- 
dle and middle and low SES performance. In 
every case but Segmentation Transfer, the dif- 
ferences are significant by 1 -tailed test 
(jd < . 05). It is known that a disproportionate 
number of poor readers come from lower SES 
schools; these data are consonant with that 
fact. Lower SES students would be expected 
to possess fewer prereading skills (or to do 
more poorly on standard tests for these skills). 



INTERNAL CONSISTENCY RELIABILITY 

The Hoyt internal consistency reliabilities 
were computed for each test. Data from all 
162 Ss (including both test orders) were pooled 
for all analyses except Segmentation and 
Transfer. For the Segmentation tests, each 
presentation of a stimulus was treated as an 
item, yielding totals of 15 items for the five 
learning trials and six transfer items. The 
computed reliabilities and standard errors of 
measurement are shown in Table 4. 

For Alphabet Naming, Segmentation Learn- 
ing, and Segmentation Transfer tests, internal 
consistency was sufficiently high (. 83 - . 93) 
to justify the use of these tests in making de- 
cisions about individuates (see Harris, 1 9 68 ). 3 
The three visual matching tests, however, 
show lower internal consistency (. 60 - . 80). 
Item analyses and implications for test revi- 
sion will be oonsidered separately for each 
test. 



Table 3 



t_-Test Values for High vs. Middle SES Scores and Middle vs. Low SES Scores 



Test 


High vs. Mid 
(df = 94) 


Mid vs. Low 
(df = 113) 


Alphabet Naminq 


2. 70*** 


2. 28** 


Visual Tests 


Letter Order 


3. 27*** 


3. 58*** 


Letter Orientation 


2. 13** 


2. 45*** 


Position Detail 


1.95* 


3. 25*** 


Auditory Tests 


Segmentation 


2. 15** 


2. 08** 


Transfer 


* 1. 18 (NS) 


.83 (NS) 



\> 1.66, 


£ < • 


05, 1 -tailed 


** 






t_> 1.98, 


£ < • 


025, 1 -tailed 


*** 






i > 2. 36, 


£ < • 


01, 1-tailed 



3 It would appear desirable to combine Seg- 
mentation Learning and Transfer as a single 
score taking on values from 0 to 21. 



13 



5 



Table 4 



Hoyt Internal Consistency Reliabilities and Standard Errors of Determination 

for Basic Prereading Skill Test 



Test 


No. Items 


M 


SD 


Hoyt r_ 


SE 


Alphabet Naming 


10 


5. 01 


3.86 


.93 


.97 


Visuai Tests 


Letter order 


16 


8. 04 


3.41 


. 80 


1.48 


Letter Orientation 


12 


5.93 


2.44 


. 60 


1.48 


Position Detail 


12 


5.22 


2.41 


. 66 


1.34 


Auditory Tests 
Segmentation 
Form A 


15 


6.28 


5. 10 


.92 


1. 36 


Form 




6. 54 


4.97 


.92 


1.40 


Transfer 
Form A 


6 


1. 33 


1. 82 


. 83 


. 68 


Form B 




1. 05 


1. 69 


. 83 


. 63 


Segmentation and Transfer 
Form A 


21 


7. 60 


6. 33 


.93 


1. 64 


Form B 




7.59 


6. 15 


.93 


1. 63 



a n = 8 3 for Form A 



n = 79 for Form B 



Table 5 



GITAP Item Analysis 
Summary for Alphabet Naming 



Item 


Difficulty 3 


Biserial r 


x b 

SO 


e b 


1. 0 


.67 


.87 


496 


1. 75 


2. X 


.64 


.88 


393 


1. 89 


3. B 


.52 


.99 


047 


7. 16 


4. A 


. 52 


O 

O 

r—i 

A 


— 


— 


5. I 


.40 


>1. 00 


— 


— 


6. S 


.54 


1. 00 


109 


9.92 


7. T 


.46 


>1. 00 


— 


— 


8. P 


.44 


.94 


. 165 


2. 78 


9. L 


.46 


V 
»— ■ 

o 

o 


— 


— 


10. D 


.37 


.97 


. 343 


3. 73 



a Proportion of 162 .Ss giving correct response 
GITAP does not compute X 5Q and p for cases in which the biserial r_ is greater than 1. 



I 




.14 



6 



SEPARATE TEST RESULTS 



Alphabet Naming 

The frequency distribution of ^Ss 1 scores 
on the 10-item Alphabet Naming task is shown 
in Figure 1; the distribution is clearly bimodal. 
Children tend to know either all or none of the 
letter names tested. Item statistics are 
summarized in Table 5. Item difficulties (ac- 
tually, the proportion of Ss passing each item) 
all fell within the recommended range of 3 0% 
to 70% for effective discriminators. The bi- 
serial r_s for item correlations with total cor- 
rect score were all well above the +. 30 con- 
sidered desirable and the +. 70 considered 
excellent (Harris, 1968). 

An X 50 value represents that total score, 
or point on the abscissa of the item charac- 
teristic curve in standard deviation units, 
which corresponds to a 50-50 probability of 
correct choice on the ordinate. The corre- 
sponding p value may be thought of as the 
slope of the item characteristic curve atXsg; 
the greater the magnitude of p, the better that 
item chpice functions as a discriminator. 
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Hi SES (n=47) 
Mid SES(n=49) 
Loses (n=66) 




01 23456789 10 



No. Correct on Alphabet Naming 



Figure 1. Frequency Distribution of Ss ] Scores 
on Alphabet Naming. 



■ Hi SES (n=47) 




Figure 2. Frequency Distribution of Ss' Scores 
on Letter Order 



Since the range of X 50 values corresponds to 
the portion of the normal curve which is being 
discriminated well, the desirable range de- 
pends upon the purpose of the test. The Alpha- 
bet Naming test was included as an early pre- 
dictor of reading achievement and, in particu- 
lar, first grade failure' in reading achievement. 
An estimated 15 to 25% of the school popula- 
tion fall into the reading failure category ac- 
cording to U.S. Office of Education figures; thus, 
the range of interest is approximately -1 to 
0 <r. For those six X 50 values which could be 
computed, the range is -. 50cr to +. 343<r , with 
an average value of -. 09<r. The p values 
which can be computed are all greater than 
the . 3 0 recommended for correct choices. 

Considerations based on item analysis and 
internal consistency, then, do not suggest item 
revision for the Alphabet Naming test. On 
the basis of experimenter observation, two 
changes will be made to avoid confusion of 
the letters with numbers. The capital I_ will 
be barred, and the initial O in Form A will be 
moved to a later position. 



Letter Order 

The frequency distribution of^Ss 1 scores 
on Letter Order is shown in Figure 2. Item 
difficulties ranged from .15 to .88. Difficulty 
appeared to be determined chiefly by the posi- 
tion of the correct alternate and the position of 
the most attractive distractor, the order re- 
versal, relative to the correct alternate. The' 
data are summarized in Table 6. 
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Table 6 



Mean Item Difficulty as a Function of Correct and Order Reversal Position 
(Number of Items in Parentheses) 



Position of Position of Correct Alternate 



Order Reversal 


1 


2 


3 


4 




Preceding Correct 


— 


.42 (2) 


.19 (2) 


. 23 (4) 


. 28 (8) 


Following Correct 


.86 (4) 


. 68 (2) 


.45 (2) 


— 


. 70 (8) 




. 86 (4) 


. 55 (4) 


.32 (4) 


. 23 (4) 





Table 7 



Letter Order Errors by SES Group 



Error Type 


High 


SES (n 


= 47) 


Mid 


SES (n = 


‘ 49) 


Low SES (n = 


66) 




% 


M 


SD 


% 


M 


SD 


% 


M 


SD 


Order Reversal 


70% 


3.98 


2. 51 


64% 


4.96 


2. 09 


48% 


4. 67 


1.90 


2nd Letter Mismatch 


22% 


1. 23 


1. 07 


20% 


1. 51 


1„ 34 


28% 


2. 68 


1. 67 


1st Letter Mismatch 


8% 


.45 


. 65 


16% 


1.27 


1. 73 


25% 


2. 39 


2. 04 


Total Error 




5. 66 






7* 74 






9.74 





Table 8 

Mean Item Difficulty as a Function of Correct and Left-Right Reversal Position 

(Number of items in parentheses) 



Position of Left- 
Right Reversal 


1 


Position of Correct Alternate 
2 3 


4 




Preceding Correct 


— 


.52 (.1) 


.32 (2) 


.35 (3) 


.37(6) 


Following Correct 


.73 (3) 


. 50 (2) 


.55 (1) 


— 


.62 (6) 




.73 (3) 


.51 (3) 


.40 (3) 


.35 (3) 





Table 9 

Letter Orientation Errors by SES Group 



Error Type 


High SES (n 
% M 


= 47) 
SD 


Mid SES (n 
% M 


= 49) 
SD 


Low SES (n = 
% M 


66) 

SD 


Left-Right Reversal 


66% 


3. 28 


1. 94 


63% 


3. 76 


1. 71 


46% 


3. 23 


1. 62 


Up-Down Reversal 


20% 


1. 00 


1. 25 


23% 


1.35 


1.16 


28% 


1.98 


1. 53 


180° Rotation 


13% 


. 66 


1. 05 


14% 


.82 


. 83 


25% 


1. 76 


1. 38 


Total Error 




4.94 






5.93 






6.97 






8 



16 




\ 



The attractiveness of the order reversal 
error increased relative to the other discractors 
for Ss making better scores. Order reversals 
comprised 48% of the low SES group's errors 
but 70% of the high SES group's mistakes 
(see Table 7). Overall, order reversal errors 
failed to correlate significantly with single 
letter mismatches. Elimination of the single 
letter mismatch alternates would not only re- 
move distractors of relative ineffectiveness, 
then, but also focus the test more specifically 
on letter order. 

Item analyses revealed that the correct 
choices discriminating most poorly were 
those in initial position (average p of . 56). 
Those correct choices discriminating best 
were preceded by the order reversal alternate 
in initial position (average p of 1. 26). For 
the latter items, order reversal choices func- 
tioned as highly effective discriminators 
(average p of 70). The reliability (corrected 
for length) of a test made up solely of the 
items in which the order reversal preceded the 
correct alternate would be . 90. 

These data suggest that the best internally 
consistent set of items would be those con- 
sisting of only two alternates, the order re- 




No. Correct on Letter Orientation 



Figure 3. Frequency Distribution of Ss' Scores 
on Letter Orientation. 



versal and the correct choice, with the latter 
always occurring in second position. Such a 
revision will be made for the next item tryout, 
with the proviso that four of the 16 items have 
correct alternates in initial position. These 
will be control items. Letters comprising the 
standard pair will be subject to the additional 
constraint that they be dissimilar, so that the 
corresponding order reversal will be visually 
dissimilar to the standard. 



Letter Orientation 

The frequency distribution of £3s' scores on 
Letter Orientation is shown in Figure 3. Item 
difficulty ranged from ,25 to .76 and appeared 
to vary as a function of the position of the 
correct alternate and the relative position of 
the most attractive distractor, the left-right or 
mirror image reversal (see Table 8). 

Left-right reversal (mirror image) errors con- 
stituted a larger percentage of the errors made 
by the higher SES groups (see Table 9); in fact, 
these errors actually increased for the middle 
SES group despite an overall decrease in errors. 
Up-down and 180° errors correlated signifi- 
cantly and positively with each other (L = * 39; 
df = 1 60; jd < . 01), but negatively or insignifi- 
cantly with left-right reversals (-.32, -.10 
respectively). Information about vertical, or 
up-down, orientation appears to be used by 
kindergartners in making immediate judgments 
of identity, while left-right reversals appear 
to be considered identity-preserving by many 
Ss. Elimination of the up-down and 180° 
alternates, therefore, would remove distractors 
of relative ineffectiveness, and sharpen the 
focus of the test. 

Item analyses revealed that the correct 
choices discriminating most poorly were those 
in initial position (average (3 of .44). Those 
correct choices discriminating best, on the 
average, were preceded by the left-right re- 
versal alternate in initial position (mean (3 of 
,86). For the latter items, left-right reversal 
choices also functioned as efficient discrim- 
inators (average (3 of -.47). The reliability 
(corrected for length) of a test made up entirely 
of items in which the left-right reversal pre- 
ceded the correct alternate would be .78. 

These data suggest that the best internally 
consistent set of items, as in the case of the 
Letter Order test, would be those consisting 
of only two alternates, with the correct choice 
always in second position. In this case, the 
left-right reversal distractor would precede 
the correct choice. Such a revision will be 
made for the next item tryout of the Letter 
Orientation Test. The total number of items 
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No. Correct on Position Detail 

Figure 4. Frequency Distribution of Ss* Scores 
on Position Detail 



will be extended to 1 6 by adding four control 
items in which the correct alternate occurs 
initially. 



Letter Position Detail 

The frequency distribution of Ss* scores on 
Position Detail is shown in Figure 4. Item 
difficulties ranged from . 16 to .83. Difficulty 
appeared to' vary with the position of the cor- 
rect alternate and the number of letters in the 
standard (see Table 10). Single letter mis- 
matches occurred equally often in each posi- 
tion for quadruple standards; overall perform- 
ance on these items was near chance. A mis- 
match in medial position was slightly more 
frequent among errors on letter triples (see 
Table 11). 

Correct choices most poorly discriminating 
Ss were those in position 1, with an average 
p of . 42, Correct choices functioning as the 
best discriminators were those appearing right 
most (Position 4) in the items, with an aver- 
age (3 of 1, 23. The reliability (corrected for 
length) of a test made up entirely of items 
with the correct alternate in positions 3 or 4 
would be ,78. 



Table 10 

Mean Item Difficulty as a Function of Standard Length and Position of Correct Alternate 

(Number of Items in parentheses) 



Standard 


1 


2 


3 


4 




Triple 


. 82 (2) 


.46 (1) 


.41 (2) 


.22 (1) 


.52 


Quadruple 


. 80 (1) 


.37 (2) 


.22 (1) 


. 17 (2) 


.35 




.81 


. 40 


. 35 


. 18 





Table 11 

Position Detail Errors by SES Group for Letter Triples 



Error Tvoe 


High SES (n 


= 47) 


Mid SES (n = 


49) 


Low SES (n = 


66) 




% 


M 


SD 


% 


M 


SD 


% 


M 


SD 


1st Letter Mismatch 


28% 


. 60 


. 74 


26% 


. 71 


.74 


31% 


1. 08 


. 85 


2nd Letter Mismatch 


48% 


1. 04 


. 93 


49% 


1. 31 


1. 04 


42% 


1.44 


1. 01 


3rd Letter Mismatch 


24% 


. 53 


. 78 


25% 


. 67 


.66 


27% 


.91 


. 82 


Total Error (6 Items) 




2. 17 






2. 69 






3.43 
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The revised Letter Position Detail test to 
be constructed will be a 16-item test, two al- 
ternates per item, with the correct alternate 
in final position on all but four items. Only 
triples will be used as standards, since quad- 
ruples proved so difficult. All three types of 
distractors will occur, since they appear to 
be equally attractive. Similarity between the 
critical letter of the standard and its substi- 
tute in the distractor will be increased, where 
possible; the letters making up the standard, 
however, will be decreased in similarity. 



Segmentation 

The frequency distributions for Segmentation 
Learning and Transfer scores are shown in 
Figures 5 and 6. Item difficulties (see Table 
12) ranged from . 27 to . 58 for Segmentation 
Learning and . 14 to . 37 for Transfer. 




No. Correct on Segmentation Learning 



o 

Z 



90 



EH Hi SES (n =47) 
Hi Mid SES (n=49) 




No. Correct on Segmentation Transfer 



Figures. Frequency Distribution of £3 s’ Scores 
on Segmentation Learning 



Figure 6. Frequency Distribution of £3 s' Scores 
on Segmentation Transfer 




The learning and transfer curves for Forms 
A and B, which differed in list makeup, are 
shown in Figure 7. Overall, £3s did slightly 
better on List B. Percent correct per stimulus 
word for List A was 38 ( feet ). 41 ( pies) , and 
47 ( shout ): for List B, 37 ( teach ). 41 ( nice) , 
and 52 ( couch ). The same ordering of difficulty 
occurred for these sets of stimulus words when 
used in the transfer test of the other form. 

A difference between the two E^s working in 
Hawthorne Elementary School was noted for 
the Segmentation Learning and Transfer tests 
but not for others. Ss tested by Experimenter 1, 
a female graduate student, earned a segmenta- 
tion score of 21% and a transfer score of 10%, 



showing little evidence of learning or transfer. 

Ss tested by Experimenter 2, a male graduate 
student, scored 31% overall on learning and 
20% on transfer. Tapes of the testing sessions 
made plain the difference. Experimenter 1 was 
following the original BPST script in which 
feedback was provided simply by repeating the 
correct response; Es 2 and 3 were both saying 
"good" or "fine" when £5 gave the correct re- 
sponse. The instructions as written clearly 
confused £5s, leading them into a repetition 
pattern of responding. Instructions were re- 
vised to conform to practice for testing in Muir 
and Stephens. Only the scores from Hawthorne 
are partially depressed by the use of the original 
testing paradigm. 
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Table 12 



GITAP Item Analyses 

Summary for Segmentation Learning and Transfer, Form A and B 



Stimulus: 

Segmentation 


Difficulty 9 


Biserial r_ 


X 50 


p 




• A 


B 


A 


B 


A 


B 


A 


B 


1. 


I 


.29 


. 27 


. 69 


. 87 


. 80 


. 72 


.96 


1. 73 


2. 


II 


. 39 


.25 


. 80 


.70 


. 36 


.95 


1. 33 


. 98 


3. 


III 


. 24 


.43 


. 88 


. 83 


. 80 


. 21 


1. 82 


1. 50 


4. 


II 


. 41 


. 37 


. 89 


.87 


.26 


. 39 


1.97 


1. 74 


5. 


I 


. 36 


.39 


.91 


.83 


. 39 


. 33 


2. 15 


1. 48 


6. 


III 


. 34 


.52 


.93 


.87 


. 45 


-. 05 


2. 61 


1.74 


7. 


I 


.40 


.49 


.75 


. 80 


. 34 


. 02 


1. 14 


1. 32 


8. 


III 


.49 


.54 


.93 


.85 


. 02 


13 


2. 63 


1. 62 


9. 


II 


.47 


.39 


. 86 


.89 


. 09 


. 30 


1. 71 


2. 00 


10. 


III 


. 52 


. 54 


.93 


. 83 


-. 05 


-. 13 


2. 57 


1. 50 


11. 


II 


. 53 


. 38 


.81 


.93 


09 


. 33 


1. 40 


2. 61 


12. 


I 


. 37 


. 38 


.98 


.91 


. 33 


. 30 


4. 54 


2. 26 


13. 


II 


. 53 


.47 


.87 


.93 


-. 09 


. 09 


1. 79 


2. 47 


14. 


III 


.47 


.58 


.99 


.94 


. 08 


-. 22 


8.98 


2. 72 


15. 


I 


.47 


. 52 


.95 


.79 


. 08 


-. 06 


2.93 


1. 29 


Transfer 


















i. 


IV 


.37 


.20 


.94 


.99 


. 34 


. 84 


2. 79 


6. 90 


2. 


V 


. 23 


.18 


>1 


.96 


— 


.96 


— 


3. 51 


3. 


VI 


. 18 


.20 


>1 


>1 


— 


— 


— 


— 


4. 


VII 


. 18 


. 15 


>1 


>1 


— 


— 


— 


— 


5. 


VIII 


. 1 6 ■ 


. 14 


>1 


>1 


— 


— 


— 


— 


6. 


IX 


. 20 


. 18 


.97 


>1 


. 85 


— 


3. 72 


— 



a n = 83 for Form A and 79 for Form B. 
Proportion of £ giving correct response. 



Two additional revisions likely to improve 
performance were suggested by the data. 
Transfer item difficulties in Table 6 indicate 
some decrement after the first item, the only 
transfer item for which feedback was given. 
Further, few Ss who showed some transfer 
got 5 or 6 items correct. Acknowledgement of 
a correct response may forestall the gathering 
confusion of children guessing correctly but 
receiving no reinforcement; in the next admin- 



istration, the E will say "good" or "fine" to a 
correct transfer response. 

A second revision was suggested by the 
Form A intralist confusion errors noted by Es: 
eat to pies and eyes to feet , apparently inter- 
fering semantic associates. In the next test 
administration lists will be revised to avoid 
this problem. 

Finally, it was suggested that learning 
might be accelerated for Ss if they were asked 
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to repeat both the stimuls and the response. 
Such an instruction would provide an articula- 
tory basis for matching the response with the 
vowel-consonant segment of the stimulus. 
Later testing of two groups of five .Ss each on 
a new list, with one group repeating both 
stimulus and response, showed a marked ac- 
celeration of learning for that group. 4 This 
task will be used in future BPST administra- 
tions. 



PATTERNS OF BPST 
MASTERY AND DEFICIT 

Correlations among the BPST tests and the 
Alphabet Naming test are presented in Table 13. 
All BPST tests correlate significantly and 
moderately with Alphabet Naming, which is 
the best single predictor of reading achieve- 
ment identified in a number of studies (e. g. , 
de Hirsch, Jansky, and Langford, 1966). Cor- 
relations of Segmentation with each of the 
visual tests are also significant but moderate. 
Visual tests are more highly correlated among 
themselves than with Alphabet Naming. 

The pattern of correlation desired in theory 
is of low correlations among BPST tests but 
significant moderate values for the correlation 
of each BPST test with Alphabet Naming. Thus, 
each BPST test would be providing a measure 
of an independent skill. In practice, of 
course, residual correlation will arise from 
task similarities and the fact that home teach- 
ing efforts may affect several skills. Corre- 
lations observed in the Fall test administration 
meet expectations with the exception of higher . 
correlations among the visual tests than 



desired. Since the distractors defined for 
the three tests overlapped somewhat (e.g., 
single letter mismatches), the test revisions 
eliminating that overlap may be expected to 
decrease visual test correlation in the next 
test administration. 

It might be asked whether the correlations 
observed arise from higher correlation at the 
extremes; that is, whether children doing 
exceptionally well (or badly) on one test do 
well (or badly) on all. The distribution of Ss 
doing exceptionally well or badly on one, two, 
three, or all four tests is shown in Table 14. 
(Segmentation transfer was excluded, since 
it was not intended as a separate test. ) 
Mastery was defined as a score of 90% cor- 
rect or better on a test. Failure was defined 
as chance performance or worse. (For seg- 
mentation, chance performance was probably 
overestimated at 33 1/3. ) 

The number of .Ss mastering a test ranged 
from 6, for Position Detail, to 24, for Segmen- 
tation; 9 Ss earned mastery scores on Orienta- 
tion and 11 on Order. .Ss performing at chance 
or worse ranged from 24 on Orientation to 78 
on Segmentation. Twenty-five failed Order 
and 45 Position Detail, Most .Ss mastered 
no tests and failed none or one. The fact that 
a _S mastered or failed one test, however, gave 
no indication that he would master or fail the 
others. Of the 16 possible combinations of 
test mastery, from none to all, all but 5 oc- 
curred. Similarly, of the 16 possible failure 
patterns, only one did not occur. 

These data highlight the importance of an 
individually prescribed instructional program 
in prereading skills and the necessity of 
diagnostic tests to accomplish the identifica- 
tion of deficits. Apparently, any pattern of 
skill deficit may occur. Optimal use of the 
child's learning time requires that instruction 
be focused on his particular set of deficits. 

But it is quite possible that no two children 
in a classroom show the same pattern of defi- 
cit, and hence that no two children in a class- 
room require the same extended instructional 
program. This is an alarming prospect indeed 
to the teacher who must accomplish the indi- 
vidualized program planning when no manage- 
ment guides or instructional activities focused 
on specific skills are available. Indeed, it is 
unlikely that any profit can arise from the ex- 
istence of a diagnostic test unless instruc- 
tional and management components are also, 
provided. The data on test mastery and failure 
patterns become a compelling argument for the 
development of a complementary instructiorAl 
program. 

4 Described in J. Seegal, Sound segmenta- 
tion response comparison test, unpublished 
report of Project 204-2, December, 1970. 
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Table 13 



Correlations among Tests for All 1970 Kindergartners (n = 1 6 Z ) 





1 


2 


3 


4 


5 


1. Alphabet Naming 












2. Letter Order 


. 59* 










3. Letter Orientation 


. 39* 


. 6l* 








4. Position Detail 


. 40* 


-S'- 

CO 

vO 


. 54* 






5. Segmentation Learning 


. 52* 


.44* 


. 32* 


.41* 




6. Segmentation Transfer 


. 49* 


.33* 


. 15 


. 23* 


. 59* 


df = 160, 2-tailed test, r_ > . 21 



Table 14 

Distribution of 162 Ss by Test Mastery and Failure Patterns 




No. Ss 


No. Ss, 


Tests 


Mastering 


Failing 


No Tests 


128 


66 


One only 


24 


47 


Order 


2 


1 


Orientation 


3 


3 


Position Detail 


2 


8 


Segmentation 


17 


35 


Two only 


6 


28 


Ord- Orient 


2 


3 


Ord-Pos 


1 


2 


Ord-Seg 


3 


4 


Orient-Pos 


0 


0 


Orient-Seg 


0 


4 


Pos-Seg 


0 


15 


Three only 


2 


15 


Ord-Orient-Pos 


0 


1 


Ord -Orient-Seg 


1 


1 


Ord-Pos-Seg 


0 


7 


Orient-Pos-Seg 


1 


6 


Four only 


2 


6 
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